CIRP_full_RGB
     How to Read the CIRP Construct Percentage Reports
CIRP Constructs are designed to capture the experiences and outcomes institutions are often interested in understanding, but that present a measurement challenge because of their complex and multifaceted nature. To measure these broad underlying areas more precisely, we use Item Response Theory (IRT) to combine individual survey items into global measures that capture these areas. CIRP Constructs are more than a summation of related items; IRT uses response patterns to derive construct score estimates while simultaneously giving greater weight in the estimation process to survey items that tap into the construct more directly. This results in more accurate construct scores. Constructs are particularly useful for benchmarking. They allow you to determine if the experiences and outcomes for your students differ from your comparison groups. Two sets of reports are generated for CIRP Constructs. The Mean Report shows comparative information based on the mean score of a construct. The Percentage Report shows comparative information based on the percentage of students who score in the high, average, and low score group of a construct. We suggest you use the report that best fits your needs as an institution.

CIRP Construct Definition – Summarizes the theoretical rationale for creating the construct.

Comp 1
– The first comparison group is based on your institution's type and control.

Comp 2 – The second comparison group is based on a similar grouping of institution type and control.

Statistical Significance – uses a proportional difference test to examine the difference between the percentage of students in the high group for your institution and the percentage of students in the high group in the comparison group. Differences larger than what would be expected by chance are noted with one, two, or three stars, which correspond to the three standard levels of significance (*p<.05, **p<.01, ***p<.001). Statistical significance measures the extent to which a difference is occurring by chance, not the extent to which a difference is practically important. Large sample sizes (like those in the comparison groups) tend to generate statistical significance even though the magnitude of the difference might be small and not practically important.

                       
  Academic Self-Concept is a unified measure of students’ beliefs about their abilities and confidence in academic environments.  
   
  Total Men Women  
  Sample University Your Inst Comp 1 Comp 2 Your Inst Comp 1 Comp 2 Your Inst Comp 1 Comp 2  
  Total (n) 1,361 4,996 14,835 503 1,586 5,527 858 3,410 9,308  
 
High Academic Self-Concept
43.6% 33.2% 30.3% 59.6% 43.0% 36.7% 34.3% 28.7% 26.5%  
 
Average Academic Self-Concept
30.3% 33.9% 39.9% 23.5% 31.6% 39.1% 34.3% 35.0% 40.4%  
 
Low Academic Self-Concept
26.1% 32.8% 29.8% 16.9% 25.4% 24.2% 31.5% 36.2% 33.1%  
  Significance (based on High score group) - *** *** - ***
***
-   **  
  Note: Significance * p<.05, ** p<.01, *** p<.001  
   
 
 
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
  Survey items and estimation "weights":
  Rate yourself on each of the following traits as compared with the average person your age:
For more information about IRT and the CIRP Construct development process, see the CIRP Constructs Technical Report at www.heri.ucla.edu  
  * Academic ability (3.01)  
  * Self-confidence (intellectual) (1.51)  
  * Drive to achieve (1.18)  
  * Mathematical ability (1.14)  

Survey Items and Estimation "Weights" – The survey items used in the creation of the CIRP Construct are presented in the order in which they contribute to the construct along with the estimation weights generated in IRT. Items that tap into a trait more effectively are given greater weight in the estimation process.

Charts – Provide a visual display of construct score group percentages for your institution and two comparison groups. CIRP Constructs have been scaled to a mean of 50 with a standard deviation of 10. "Low" represents students who scored one-half standard deviation or more below the mean (less than 45). "Average" represents students who scored within one-half standard deviation of the mean (45 to 55). "High" represents students who scored one-half standard deviation or more above the mean (higher than 55).